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Abstract 

We study the aggregation of AR processes and generalized Ornstein-Uhlenbeck 
(OU) processes. Mixture of spectral densities with random poles are the main tool. In 
this context, we apply our results for the aggregation of doubly stochastic interactives 
processes, see [4]. Thus, we study the relationship between aggregation of autoregres- 
sive processes and long memory considering complex interaction structures. We precise 
a very interesting qualitative phenomena: how the long memory creation depends on 
the poles concentration near to the boundary of stability (measured in the Prokhorov 
sense). Our results extends the results given by Oppenheim and Viano, [12], and high- 
light the importance of the angular dispersion measure of poles in the appearance of 
the long memory. 

Keywords: Aggregation; long memory; mixture of spectral densities; AR processes; 
Ornstein-Uhlenbeck processes. 

1 Introduction 

Long memory (LM) processes, are used in many fields such as economics, finance, hydrology 
or communication networks. Some of these LM processes can be seen as an aggregation of 
elementary short memory (SM) processes. 

The aggregation of stochastic processes was introduce by Granger in 1980, [7]. It is a 
sommation procedure of identically distributed elementary processes = {Z^ : i G Z} over the 
index i. Granger shows that by aggregating random parameter AR(l) processes, one can obtain 
LM processes with spectral density equivalent to |A|~'' when A ^ for some rf, < < 1. 
He considers j4i?(l) processes with independent random Beta distributed parameters and gives 
conditions on the Beta distribution in order to obtain long memory. That has opened a new 
way of obtaining long range dependence time series. 

As indicated by Beran, [2]. this is an interesting idea from two different points of view: it 
allows a physical explanation of the long dependence phenomenon in several fields and it gives 
an easy and fast simulation method. 

We develop the procedure of aggregation considering doubly stochastic AR{p) (or generalized 
Ornstein-Uhlenbeck process of order p) elementary processes = {Zt(y*,£*) : t G T}, where 
Y = {y* : i e N} is a sequence of random variables with distribution ^ on K.'' and £ = {e'^ : i E 
N} is the sequence of innovations e' — {ej : t £ T}. Finally, T = Z in the case of discrete time 
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processes and T C K in the continuous time case. We assume that Y and £ satisfy the following 
assumption. 

Assumption Al: 

1. £ is an array of strong white noises, i.e. for each i, = {e\\ is an i.i.d sequence such 
that E[|£j|2] = 1. 

2. Y is an i.i.d. sequence with distribution v — /i®^. 

3. Y is independent of E . 

Then, we define the sequence of partial aggregations {Y) = {X[^{Y) : t e T} of elemen- 
tary processes {Z'^}, by 

1 ^ 

Xr{Y)^—Y,Zt{f,e^), (1) 

where {Bn} is a normalization sequence. 

In general, we consider three types of innovations: 

1. Common innovation: e* = e for all i G N. 

2. Independent innovations: independent of for i ^ j. 

3. Stationary interactive innovations: E[ej£j] = x(* ^ j) and E[£j£i] = ioi t ^ s, 
where x is an interaction correlation. 

The aggregation procedure of doubly stochastic linear processes can be also develop using 
mixtures of spectral densities and mixture of transfer functions as main tools, see [4]. Let 
gi^^y), y S I^^i be a family of spectral densities and /z be a probability on W. We will denote 
by ^('jy) a particular square root of g{-,y), some time for simplicity we consider the real one. 
In other case, there exists a root linked with a regular representation. This is always possible 
for autoregressive process of order p. 

We consider, for y' fixed, that (7(A,y') is the spectral density of the elementary process 
— Z{y\e^). The mixture of the spectral densities (?(A, y), is defined by 



F{X)= / 5(A,y)M(dy). (2) 
F(A) is a well defined spectral density if and only if 

j F{\)d\ < oo. (3) 
The mixture of transfer function given by 

HiX)= [ hiX,yMdy), (4) 



is well defined and will be called a transfer function if is a spectral density. This is a 
consequence of condition ([3]) and Jensen's inequality. 

Without loss of generality for the purpose of this chapter, we assume that £ = {e^} is a 
sequence of Gaussian white noise, except for some remarks. 

Under some general conditions for the interaction x we show in [4] the i/ — a.s. weak conver- 
gence of X^{Y) to a process X called the aggregation process. 

In the independent innovations case, we take _Bjv = v'^, then one can show that the ag- 
gregation process exists v — a.s. if and only if condition ([3]) hold. In this case the aggregation 
process X is Gaussian with spectral density F. Nevertheless, for the common innovation case. 
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taking Bj^ ^ N we can prove that condition ^ implies the existence v — a.s. of X, in this case 
X is a Gaussian process with spectral density 

For the case of interactive innovations we have show, in [4]. that in general condition ([5]) is a 
necessary and sufficient condition for the existence v — a.s. of aggregation process X . Moreover, 
the limit is always a convex combination of the two extreme cases: independent innovations 
(F(A), Bn = Vn) and common innovations {H^{X), Bn = N). In general, the limit is reached 
for a normalization Bn which depends on the behavior of interaction x- Fcrmin, [5], generalize 
this results for the case of non-gaussian innovations, considering a sequence £ = {e*} of weakly 
dependent innovations. 

Thee long memory of a stationary process is de defined by the nonsummability of the cor- 
responding covariance sequence 7 = {7(fc) : k G Z}; i.e. when the norm ||7||i = |7(fc)| < 00 
we say that the process is SM and if ||7|ji = 00 then we say that the process is LM. The long 
memory sequences are generally associated to the singularities of the spectral density. 

The non-uniformity of ||7(-,y)||i, for different values of y, can generate long memory by 
aggregation. In the spectral density context, this phenomenon is related with the concentration 
of the mixture measure fx near the boundary of the existence domain for elementary processes, 
defined by the set of parameters y such that g{X, y) is a well defined spectral density; i.e. the set 
{y : / g{X,y)dX < 00}. For instance, in the case of AR{1) processes aggregations, we have an 
only way of creating long memory; that is, when the measure fi of the autoregressive parameter 
is concentrated near {—1,1}, which is the boundary of the domain of parameter values leading 
to stationary AR{1). 

Several authors, [3,6,9,10,13], study the long memory on the aggregation of AR{1) and AR{2) 
processes, but considering only the case in which the spectral density has an only singularity 
at zero, which induces long memory but without seasonal effects, for the continuous time case 
see [1,8,11]. In [12], the authors show how to obtain seasonally LM models from the aggregation 
of autoregressive processes in the discrete time case as well as in the continuous time case. 

Our purpose is to clarify in a more general context, the conditions linked to the existence and 
the long memory property of the aggregation of AR and OU processes. The results given in this 
paper are an extension of the results shown in [12]. Our generalization consists in considering 
poles with multiplicity and with diffuse angular distribution. 

We shall exhibit a new qualitative behavior: for p > 2 the long memory is not guaranteed 
even if the radial distribution of poles diverges in 1; the angular distribution of poles is also 
determinant and can counterbalance the radial distribution. For instance, for AR(2) elementary 
processes, if {pe^^)~^ is a random pole and if 6 has a diffuse measure then p has to be very 
concentrated near { — 1,1} whereas if 6 has a concentrated measure near to a given frequency 
then conditions on p can be relaxed. 

Results are presented as follows. In Section [21 we show that for suitable distributions of 
the AR{p) parameters the aggregation process exists and we give the expression of its spectral 
density. Furthermore, we give necessary and sufficient conditions for this spectral density to 
have predetermined singularities which imply the long memory, we study in detail the cases of 
AR{1) and AR{2) processes and we present a general result for the case AR{p). We illustrate 
how the long memory can "disappear" when the angular distribution of of poles is diffuse. In 
Section [3] we extend the results given in Section [2] to the case of the aggregation of OU (p) 
processes. 

2 Aggregation of AR{p) processes and long memory 

Let D be the open unit disc. For y = (yi, yp) e D^, let Zt{y, e) denote the autoregressive 
process with innovation e satisfying 



p 




(5) 
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We assume that the corresponding characteristic polynomial is factorizcd of the following way 

p p 



fc=l k=l 

So {1/yfe : k = 1, ...jP} is the set of random poles of the AR{p) process. The process Zt{y,£) 
has the My4.(oo) expansion 

oo 

Zt{y)^<7Y,Ck{y)et-k, (6) 

fc=0 

where A-\s,y) = J2'^^o Ck{y)s^ . 

Suppose that y is a random vector independent of the innovation e and whose distribution 
jjL has support . From the independence assumption and because /^dyfel < 1) = 1 for every 
fc, the series in dH) converge almost surely for /x-almost all y. The induced process Zt{y,e) is, 
for almost all y, a stationary AR{p) process with spectral density g(A,y) = CT^|A(e'^, y)|~^. We 
take the transfer function h{\,y) = aAi^e^^.y)'"^ = o" Cfc(y)e*'^'^. 

Since i^(A) = E[g(A, y)], H{\) ^K[h{\y)] and 

E^[|^t(y)l'] = r g{\y)d\ 

J —IT 

where W[-] denotes the conditional expectation given y, then we have that Zt{y,e) exists in 
if and only if condition jS]) holds. 

We take {Z"^} as a sequence of random parameters AR{p) processes, with Y = {y*} a 
sequence of random vectors in D^. Without loss of generality for the purpose of this paper, we 
assume that £ = {e*} is a sequence of Gaussian white noise. We suppose that Y and £ satisfy 
the Assumption Al and so we have the convergence results of Theorem 1 given in [4]. 

We denote by A]R(p) the class of AR{p) processes and by M(AR(p)) the class of processes 
that can be obtained by aggregation of elementary processes in AM(p). 

In this section, our aim is to give a way of taking the measure fi that allows us to obtain the 
long memory property for X. 

From now. we will consider that A{s,y) is a polynomial of degree p with n real roots and 
2(q — n) complex pairwise conjugate roots; i.e., 

n q 

A{s,y) = l[{l±p,,sy^- n [{^~Pke'''s){^-Pke'''''s)r\ 

k=l k=n+l 

where n < q, nik is the multiplicity of the root y^^, where yk = PkG^^^ with 9^ G [— tt, tt), 
Pk S (0,1) and p = '^fc + TTij. Furthermore, we will consider the following 

assumption. 

Assumption Bl: Let pi,...,pq be independent random variables, such that pk has for distri- 
bution 

dRu{p) = \l-p\''''Vk{p)dp, (7) 

where ipk is a bounded positive function with support [0, 1], continuous in p = 1 with </3fc(l) > 0. 
Let 9i, ...,6q be independent random variables and independent of pi, Pq, such that 9^ has for 
distribution 

where (3^ < 1, ij^k is a bounded positive function with support {—it, tt], continuous in 9 = 9^ and 

Mel) > 0. 
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Remark 1 Note that when f3f; 1 and ip^ {(^) ^ for 6^9^, then the measure Qk converges 
to Dirac's delta; i.e., by convention when (3k — ^ we will consider Qk{d) ~ S{0 — Thus, we 
consider /3fc = 1 and 6'^ e {0, n} , for 1 < k < n, without more details. 



Then, if condition ^ is fulfilled we have that 

F(\) ^ TT ^^"(^^ rr r r dRkip)dQk{9) 
H(\) - IT '^^^(^^ rr r r 



(9) 



(10) 



Remark 2 W^e study in detail the cases of independent innovations and common innovation. 
Since, in the case of interactive innovations the .spectral density of the aggregated process is 
always a positive convex combination of the form aF + b\H\'^ then the results in this last case 
can be deduced from the two previous cases. 

In the following we will consider that A\ ^ B\ near A = Ao, if limA^Ao A\/ B\ is a non-null 
constant. Under Assumption Bl we have the following lemmas. 

Lemma 1 

1. // — 1 < dfe < Jifc — 1, then near A = 



|l-pe*^|"'= |A|"'=-i-'''= Jo (l + u2)»'=/2' 

2. If —1 < dk < rik ~ I, then near X ~ tt 



3. If -1 < dk < Jifc - 1 and ^ {0, tt}, then near A = ±0° 

|l-p|^'=(/9fc(p)dp ^fc(l)[2sm(0O)]-"^ p u'^'^du 



Lemma 2 Let Offc < 1 and 

ff., r f' \i~p\''''Mp)M0)\o~ot\-'"'dpd9 

' J -Jo [\l-pe^(^+<^)\\l-pej(^-o)\]^^ ■ 
1. If Uk - I < dk < 2?ik - 2 + Uk, 9l = 0, then near A = 

M^)i'k{o) f°° p u'^^iei-^^dude 



|^|2«,-2-d,+a, J_^J^ [((5, _ 1)2 + y2)((g) ^ 1)2 _^ y2)]«,/2 " 

2. If Uk — 1 < dk < 2nk — 2 + ak, 9^ = IT , then near A = tt 

iPk{i)M^) r r u''^\9\-''>'dud9 



fkiX) 



\X _ T,\2n,~2-d,+a,J_^J^ [((5, _ 1)2 + y2)((g) + 1)2 + y2)]nfc/2 " 

3. If Uk ~ 2 < dk < Uk ~ 2 + ak and 9^ ^ {0, tt} , f/ien near A = ±0" 
fk(X) ^ 



A=F6iO|"'=-2-'ifc+"fc 7_^|6liF l|"fc-i-'i'= 7o (l + u2)"'=/2 
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Wc do not give tlic proof of tlicsc lemmas, since they are similar to those given for Lcmma[3] 
and Lemma 21 for the continuous time case, we referred to Section [3] 
When the measures dRk are concentrated near of the boundary 



of DP, then the first n terms in ([9]), or in (fTO|) . can only produce a singularity in F, or respectively 
in H, at the frequencies or tt, while singularities at other frequencies can be provided by the 
last terms. So, for the study of the long memory, the behavior of the measures dRk near the 
boundary SD is essential. 

If the mixture probabilities dQ^iO) are regular or very diffuse, for instance the Lebesgue 
measure on some finite interval, and if their supports do not intersect {0, tt}, then the long 
memory induced by the p concentration near 1 can "disappear"; i.e., it is not enough to have 
the mixture probabilities dRk concentrated near 6DP to reach LM by aggregation of the ran- 
dom parameters AR{p) processes. In fact when the aggregation process exists and dRk are 
concentrated near SD^ then is sufficient that the probabilities dQk are close to probabilities 
with support of Lebesgue measure 0. This is a new result. 

In the following we characterize the probability measures dR and dQ in order to make 
condition ([3]) hold and to obtain the long memory property of aggregation process X. First, 
we study in detail the case p = 1 and p = 2, and then we give an example in the case p = 2 
where the long memory "disappears" by randomness of the parameter 9. Finally, we present 
the general result in the case of AR{p) processes. 

2.1 Case of AR(1) processes 

In this section we study the aggregation of random parameter AR{1) processes consider- 
ing dependence between individual innovations in order to show the inffuence of interactive 
innovations on the construction of LM processes. 

From convergence results given in [4], we have that a necessary and sufffcient condition to 
obtain the existence of aggregation process is that the interaction correlation x has a limit in 
the Cesaro sense. In this case the limit s is such that — ^ < s < oo. Thus we consider the 
following two types of interactions. 

• Weak interaction: when— ^ < s < oo. For instance, short interaction such that \xij)\ < 
oo, or large range moderate oscillation when xU) < ^ ^-^d 1x0)1 = oo. 

• Strong interaction: when s = oo. For instance, when x{j) < oo. 

We have that the spectral density F and the transfer function H are given by 



When dR is concentrated near enough the boundary 6D = {1} of D, we can produce a 
singularity on F and on H at the frequencies G {0, tt}. By taking, dR{p) as in ([7]) and 
applying Lemma [T] we can verify that 

i. If -1 < d < 1, then near X ^ Oq F{X) = ^Tr^pm. 

ii. If -1< d < 0, then near A = 6*0 \H{X)\'^ = jj^^^^. 

Furthermore, we have that J F{X)dX < oo if and only if d > and J \H\'^{X)dX < oo if and 
only if d > — i. Then we obtain the following theorem. 
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Theorem 1 [Aggregation of AR{1) processes and long memory.] If we consider the aggregation 
of AR{1) processes with random parameter y satisfying Assumption Bl , then we have 

1. Independent innovation case: the aggregation X exists if and only if d > and X is 
a long memory process if and only if d < 1 . 

2. Common innovation case: the aggregation X exists if and only if d > — i and it is a 
long memory process if and only if d < 0. 

3. Interactive innovation case: 

3.1. Weak interaction: the aggregation X exists if and only if d > and it is a long 
memory process if and only if d < 1. In this case does not produce long memory. 

3.2. Strong interaction: we obtain the same result that for common innovation. 

From the above result follow two qualitative ways of obtaining a-LM processes, for < a < 1; 
i.e. LM processes with spectral density G(A) such that G(A) ^ \\-0o\a near A = 6*9: 

1. If < d < 1 then considering weak interaction between innovations, we can obtain by 
aggregation a-LM processes with < a < 1 from F contribution. In this case does 
not produce LM. 

2. If — i < < then considering strong long interaction between innovations, we can also 
obtain by aggregation a-LM processes with < a < 1, from contribution but for a 
much stronger concentration of the mixture measure near SD. 



2.2 Case of AR{2) processes 

In this section we give a complete analysis of aggregation of AR{2) under Assumption Bl. 
We consider two type of AR{2) processes. The first type are AR{2) processes with different real 
poles yi = Pi, y2 = P2- The second type are AR{2) processes with complex conjugated random 
poles yi = /oe*^, y2 = pe^'^ (for which we obtain the particular case of doubly real poles when 
0e{O,7r}). 

Case 1: Different real poles 

In this case we consider pi ^ p^, ^ {0, tt} and Pi — 1 for i — 1, 2. Then 

^2 ^2 



- II (I-peV.^)) '^^-^^^i \l^pJ(^-^i)) '^^-(^)- 

Taking, dRi{p) as in ([7]) and applying Lemma [T] we can verify that 
i. If -1 < di,d2 < 1, and el ^ Bl, then near A = 6lO, for i = 1, 2, F(X) 



Oll-tJi 



i'. If -1< di, ^2 < 1, and B\ = d\, then near A = B\, F{\) = . 
ii. If -1 < di, d2 < 0, and B\ ^ 6*5, then near A = 0,", for i = 1, 2, \H{\)\ = p^r^rpi-- 
n'. If -1 < di,d2 < 0, and = 6*^, then near A = 6lO, for i = 1, 2, \H{\)\ = . 

On the other hand, when 6'" 7^ 6*2 we have that J F{X)dX < 00 if and only if di > 0, ^2 > 
and / \H\'^{X)dX < 00 if and only if di > -5, ^2 > -i. 

When 91 = 6'§, / F(A)dA < C50 if and only if di + ^2 > 1 and / \H\^{X)dX < 00 if and only if 
di + d2 > -1- 
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Case 2: Complex conjugated poles 

In this case we consider two complex conjugated poles /oe'^, pe~ 



1 



Jo (l-/9eM>-e))(l-pe'(A+e)) 
We take dR{p) as in ([T]) and Q as in ([8l). Then, applying Lemma [1] and Lemma [2] we obtain 

i. If -1< d < 2 + /3, /? < 1 and 6*" G {0, tt}, then near A = 6*" F(A) = 

i'. If -1< d < /3, /3 < 1 and 6i" ^ {0, tt}, then near \^e° F{\) ^ \^^g\\p-a - 

ii. If -1< d < /3 < 1 and e° e {0, tt}, then near A = 61" \H{X)\ = 
ii'. If -1< d < /3- 1, /3 < 1 and 6*° ^ {0,7r}, then near A ±9° \H\{\) 



On the other hand, when 0^ S {0, tt} we have that J F{X)d\ < oo if and only if d > 1 + /? 
and / \H\'^{\)dX < oo if and only li d> (3 ~ \. 

When 6lO ^ {0, tt}, then / F{X)d\ < cx) if and only if > -1 + /? and / |i/|2(A)dA < oo if 
and only if d > /3 — | . 

Finally, we can summarize these results in the following theorem. 

Theorem 2 [Aggregation of AR{2) processes and long memory.] If we consider the aggregation 
of AR{2) processes with random parameters satisfying Assumption Bl, then we have 

1. Independent innovations case: 

Different real poles: /3i = 1, 9i £ {0, tt} for i = 1,2. 

• 6\ = X exists if and only if di + d2 > 1, and it is a LM process if and only if 
di,d2 < 1 . 

• 01 ^ X exists if and only if di,d2 > 0, and it is a LM process if and only if 
min{di, ^2} < 1. 

Complex conjugated poles: f3 < 1. 

• 0'^ ^ {0,n}, X exists if and only if d > 1 + (3, and it is a LM process if and only if 
d<2 + (3. 

• 0'^ ^ {0, tt} , X exists if and only if d > —1 + /3, and it is a LM process if and only if 
d< p. 

2. Common innovation case: 

Different real poles: Pi = I, 0i € {0, tt} for i = 1,2. 

• 01 = 02, X exists if and only if di + ^2 > —1, and it is a LM process if and only if 
di,d2 < 0. 

• 01 ^ 02, X exists if and only if di,d2 > and it is a LM process if and only if 
min{di, ^2} < 0- 

Complex conjugated poles: /3 < 1 . 

u 0'^ E {0, tt}, X exists if and only if d > p ^ ^, and it is a LM process if and only if 
d<p. 

• 0^ ^ {0, tt}, X exists if and only if d > P — ^, and it is a LM process if and only if 
d< P-l. 



Remark 3 For different real random poles with distribution concentrate enough near p ~ 1 we 
find the same long memory behavior in M(AR(2)) as for M(AM(1)). 
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2.2.1 Opposite phenomena: disappearance of long memory by randomness 
of 6 parameter 

Now we illustrate how the long memory can "disappear" by randomness of 9. Here we only 
consider the case of complex and not real random poles pe^^, pe~'^ and independent innovations. 
This result can be easily generalized to the case of interactive innovations. We denote by Sq 
the closed support of Q. 

As we have already mentioned when = 1 we consider that the measure Q is a Dirac's 
delta; i.e. Qk^O) = S{e - 0°). For < /? < 1 the measure dQ{0) = tP{0)\0 - B°\-l^d0 is strongly 
concentrated near 9^ and for /? < this measure is regular. In the particulary case of /3 = we 
consider that ij] is such that Q is a diffuse measure. For instance, if we take il:{9) = IL(^j ^.^j (6*) 
then Q is a uniform measure on {ti,T2). With respect to dR, we have that when —1 < d < 
this measure is strongly concentrated near p = 1 , and when c? > then dR is a regular measure. 

In Theorem [2] we have given conditions under parameters (3 and d in order to obtain the 
existence and the long memory property of the aggregation process by means of the aggrega- 
tion of AR{2) processes. We resume this result in the case of random poles and independent 
innovations in Figure [T] and Figure [21 where we show the values of a-LM parameter obtained. 




Figure 1: Values of a-LM parameter (case: Sq does not intersect {0,7r}). 

Figure [1] represents the existence of the aggregation and the LM property in terms of the 
values of (d, (3) in the case where Sq does not intersect {0, tt}. We recall that we always consider 
d > — 1 and (3 <\. The doted region corresponds to the values of the parameter (d, /3) for which 
the aggregation does not exist. The white region corresponds to values where the aggregation 
exists but there is no long memory. The remaining region corresponds to the values for which 
we obtain the existence and LM property. In this last region we plot the a-LM parameter, 
which is given by a = — d. Here, black stands for the maximum value of a (in our case 
a = 1, corresponding to an aggregation process strongly dependent) and white stands for its 
minimum value (a = 0, coinciding with the case where the aggregation exists but there is no 
long memory). 

We can appreciate that for a value of d fixed, if (3 is small enough, then the LM "disappears" , 
i.e. we can take a measure Q regular enough such that we do not get LM property. For instance, 
for < d < 1 fixed, if we take Q as a Lebesgue measure (i.e. (3 ~ {)) such that Sq does not 
intersect {0, tt}, then we do not obtain the long memory. 

Roughly speaking, it is not enough to have the mixture probability concentrated near 5D = 
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{p — 1} to reach LM by aggregation. But if we take a measure Q such that it is close to a 
probability with support of Lebesgue measure 0, for instance /3 > 0, then we obtain the LM. 
On the other hand, if the measure dR is very concentrated near p = 1, i.e. d — > — 1, then it is 
necessary to take a regular measure Q (/3 < 0) so that we get the existence of aggregation. 

When Sq intersects the set {0, tt}, we have that a = /3 — (c? — 2), and we obtain a similar 
behaviour to the precedent case. We note that in this case the corresponding graphic is the 
same but translated two units in d-axis, see Figure [21 




Figure 2: Values of a-LM parameter (case: or vr in Sq). 

2.3 General case of AR{jp) processes 

Now, we present the general result in the case of AR{p) processes that allows us to give the 
condition under the measures dR and dQ in order to obtain the existence and the long memory 
of the aggregation process. This result is based on Lemma [T] and Lemma [2l 

We denote Uk = 2mk in the case of independent innovations and Uk = mk in the common 
innovation case. 

Theorem 3 f Aggregation of AR(p) processes and long memory.] Let {Z^ : i G N} be a 
sequence of AR(p) processes defined as in ([5]), let {p^} and {9^} be the corresponding sequences 
of random parameter vectors, with pP = and 9^ = (0^,...,^^) for j G N. Let p and 

9 satisfying Assumption BL Then, the aggregation exists if and only if the three following 
conditions hold: 

• Efcexi "fe(l + ll{/3<i}(/3fe)) -2 + Pk-dk<l. 

• Efcex^ + ll{/3<i}(/3fe)) -2 + pk~dk<l. 

• muikeK^ink - 2 + /3fe - dfe} < 1 

where Ki ^ {k : 9^ = 0}, K2 = {k : 9^ ^ n} and K3 = {k : 9l {0, tt}}. 

Moreover, X is a long memory process if and only if some of following conditions is satisfied: 

• Vfc e Ki, na{/3<i}(/3fc) - 1< dfc < nk{l + l{^<i}(/3fe)) - 2 + /?fe. 

• Vfc G K2, nk\p<i}{l3k) -l<dk< Ukil + l{/3<i}(/3fe)) - 2 + /?fe. 

• There exists k S such that Uk ~ 2 < dk < Uk — 2 + Pk- 

The proof of this theorem is similar to the proof that we will give for the continuous case. 
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3 Aggregation of OU{p) processes and long memory 

The purpose of this sections is to estabUsh the analogues results to Section [2] for the contin- 
uous time case. 

We consider elementary processes as stationary solutions of p-order linear stochastic 
differential equations LSDE{p) driven by a standard Brownian motion . We call these 
elementary processes Ornstein-Uhlcnbeck processes of order p, OU{p). 

We consider that the characteristic polynomial associated to LSDE{p) equation is factorizcd 

as 

p 

k=l 

where, y = (yi, . . . ,yp) is the vector of random roots, whose distribution has support (0,oo)p. 
Let Cs(y) be the inverse Laplace transform of A{s,y)~^ defined on IR+. Wc define the OU{p) 
process with characteristic polynomial A{s,y) by 

Zt{y) := / Cs{y)dWs, teR+. (11) 

This process is, — a.s., a stationary centered Gaussian process with spectral density g{X,y) = 
a^\A{s,y)\~'^ . We consider the transfer function /i(A,y) = aA(s,y)~^. 

If F is the mixture given by F{X) ~ E [g(A, y)], then the process given in (fTTjl is well defined, 
when y is a random vector, if the distribution /i of y satisfies condition ((3|l. 

Let us consider a sequence {Z\ : z e N} of OU{p) processes and note by {W^} and Y — {y*} 
the corresponding sequences of Gaussian innovations and random parameter vectors. We assume 
that {M^'} and Y satisfy the Assumption Al and that interaction x satisfies the hypothesis of 
Theorem 1 given in [4]. 

We denote by Ol]{p) the class of OU{p) processes and by M(OU(p)) the class of processes 
that can be obtained by aggregation of elementary processes in OU{p). 

In the sequel, we consider that 

n <3 

Ms,y) = l[{s + r„r>' Y[ [(s + r,+^T,)(s + rfe-^rfc)]™^ 

fc=l k=n+l 

is a polynomial of grade p with n real roots and 2{q — n) complex pairwise conjugate roots 
having strictly positive real parts, where n < q, is the multiplicity of the roots y^ = rk ±iTfc, 
with Tfc = for 1 < fc < n, and p = X]fc=i m-k + 2 J2'j=n+i "^r 

For r = (ri, Tg) and r = (ri, Tq) fixed, under condition ^ Zt is a, stationary centered 
Gaussian process with spectral density 

" 1 ' 1 

^) = n (A2+r2)™. [((A-rfe)2 + r2)((A + r,)2+r2)]™.' ^^^^ 

and transfer function 

n ^ q ^ 

HX, r, r) = n ^^x + nY-" n [{{X-n)i + rk)iiX + Tk)i + r,)]--^- ^^^^ 

ri — 1. K — TL J. 

As in the discrete case, we will consider the following assumption. 
Assumption B2: Let ri, ■■■,rq he independent random variables, such that has distribution 

dRk{r) = \rf''Mr)dr, (14) 
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where ip^ is a bounded positive function, continuous in r = with (/5fc(0) > 0. Let Ti, ...^Tq be 
independent random variables and independent o/ri, ...Trq, such that Tk has distribution 

where Pk < ^ 'i'k is a bounded positive Junction, continuous in t ~ and tpk{Tk) > 0. By 
convention when (3k ^ ^ we will consider Qk{T) ~ S(t — t^) and = for 1 < k < n. 

Let us now study the local behavior of the spectral densities F and p, defined by equations 
(21) and respectively. We take = 2mk in the case of independent innovations and = ruk 
in the common innovation case. Then, under Assumption B2 we obtain the following technical 
lemmas. 

Lemma 3 

1. If —1 < dk < nk — I, then near A = 



2. If —1 < dk < nk — 1 and ^ 0, then near A = ±r^ 

\r\'^>'ipkir)dr v'fc(0)(2TO)-"'= roo ^d,^^ 



[((A-T0)2+r2)((A + T^")2+r2)]«^/2 \X^T^\n.~l-d,J^ + y2)„,/2 " 

Proof The first part is shown by making the variable change r = |A|m and then taking 
limits as A ^ 0. The condition — 1 < rffe < — 1 implies the convergence of the following 
integral ^^^^^^^t^du. 

The second part can be proved in the same way, with the variable change r = |A =F r^|u and 

.0 

fe- 



taking limits as A ^ irP. 



□ 



Lemma 4 Let afe < 1 and 

\r\'^^MrHk{T)\T - T^j-^'-drdT 



A- (A) 



OO /'OO 



lo [((A - t)2 + r2)((A + r)2 + r2)]"^-/2 " 
1. If Uk ^ 1 < dk < '2nk — 2 + Q!fe and — 0, then near A = 

<^fc(0)V'fe(0) f°° f°° u'^>'\6\-°"'dude 



fk{\) 



|^|2n,-2-d,+a, J _^ [((^ _ y2)((g) _^ 1)2 ^ y2)]n./2 " 

2. If Uk — 2 < dk < rik ~ 2 + Uk and 7^ 0, then near A = ±t^ 



|^^^0|„.-2+a.-d. 7_^|6'Tl|"''"^"''''7o (l + u2)"'^/2' 

Proof We show point 1 by making the variable changes r ~ \X\u and t = X6 and then 
taking limits as A 0. The result holds if the integral 

r°^' u'^'-dudO 

I := 



— 00 



[{{e - 1)2 + u2)((6l + 1)2 + u2)]n./2|5/|a. 
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is convergent. To verify that we will use that 

7/2(1 + e^+ u^) < ((0 _ 1)2 + u^)(^{e + 1)2 + ^2) 

and then we will make the following variable change: u = (1 + 6l2)^r, fr om where 



/ < 



^Jo (l + 02+^2)„,/2|0|a. (^^^2)^^li^^ 7o (l + r2)»'./2- 



Finally we have that these two last integrals converge if afe < 1 and — 1 < rffe < 2nk — 2 + ak- 
To prove point 2 we make two variable changes r = |A =F ''"1" and r — = {X^t^)9, which 
give us 



r u''^ipki\XTT°\\0Tl\u)dud0 

Jo [(1 + u^mX ± rO) ± (A T rO)0]2 + [(A T r^,K0 T l)u]^)r^/^ ' 

Then, taking limits as A ^ ^'''fe j 
Jk[X)-' 



Finally, we can see that these two integrals converge if ak < 1 and Uk — 2 < dk < rifc — 2 + afe. 

□ 



From Lemma [3] and Lemma |4] and under Assumption B2 we show the following theorem 
which gives the condition over parameters d, (3 that allows us to obtain the long memory for the 
aggregation of OU (p) processes. 



Theorem 4 [Aggregation of OU{p) processes and long memory.] Let {Z' : i G N} he an i.i.d 
sequence of OU(p) processes defined as in (jlip . let {W''}, {r*} and {r*} be the corresponding 
i.i.d sequences of Brownian motions and of random parameters vectors. Let r and t be random 
vector satisfying Assumption B2. Then, the aggregation exists if condition ^ holds and there 
is long memory if and only if 

dfe <nfe(l + ll{o}(rfe°)%<i}(/3fe))-2 + /3fe, for some k G {1, ...,q}. 



Proof It is clear that condition ^ implies the aggregation existence. On the other 
hand, as long memory of the aggregation is related to the spectral density singularities, then by 
Lemma |3] and Lemma lU the result holds. 

□ 



This theorem generalizes the results given by other authors in the following sense: in our 
approach r is a random parameters vector and not a constant vector, moreover we consider 
multiple roots. In the case where /3fe = 1 for 1 < fc < q, i.e. when we consider the parameters 
vector T fixed, the necessary and sufhcient conditions for the aggregation existence can be 
easily written in terms of the parameters dk and Uk , as we can see in the Corollary [T] In the 
general case, the aggregation existence does not depend on the decay of functions (pk and tpk, 
for 1 < k < q. For instance, it can be seen that in the case of OU{2) processes if we consider 

(fik bounded and Tpk{T) ^ \t\~^'' A |r|~'^'= with /3fe < 1 and /J^, > 0, then the aggregation exists 
if and only if 1 + /?fe < dfe < 2. 

The following corollary generalize the result given in [12], because these authors consider 
only the case of simple roots and r fixed. 
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Corollary 1 Let {Z* : i G N} be an i.i.d sequence of OU{p) processes, {W^} , {r*} and {r*} 
the corresponding i.i.d sequences of Brownian motions and of parameters vectors. If we consider 
Qfe = 1 for 1 < k < q and the parameters vectors r and t satisfying Assumption B2, then the 
aggregation exists and there is long memory if and only if the following conditions hold: 

• —1 < rffc < rifc — 1 for 1 < k < n. 

• rifc — 2 < rffe < nfc — 1, for n < k < q. 

• J2k=i nk-dk <n+l. 



Proof By applying Lemma [3] and if —1 < dj. < tij. — 1, for 1 < fc < g, then near to A = 
we have that the spectral density G of the aggregation process is such that 



" 1 r°° n.dk 



and near to A = ±rj? 



G(A) 

Moreover, we have that 



V?A;(0) p u'^*du 



G(A)< 



which allows us to bound G when A ±oo. Then, the aggregation exists if and only if 
— 1 < dk < nk — 1 for 1 < k < q, Uk ~ 1 ^ dk < 1 for n < k < q, and X]fc=i n-k ^ ^ ^ dk < ^■ 
Furthermore, there is long memory if and only if — 1 — > for some k € {1, g}, from 
where the theorem holds. 

□ 



A slight modification in the proof of Theorem [4] allows us to extend these results when we 
consider the measures dQk as 

where ^k is a positive function with singular points si, . . . , 5;^. such that for each Sj there exists 
a function V'j.fe, regular in a neighborhood V{sj) of Sj, such that 

^k{s)^-^tM^ for seV{s,) 
and '^k a function bounded out of IJ^- V{sj). 

Remark 4 In the aggregation of OU processes the phenomenon of disappearance of long mem- 
ory also can happen by randomness of parameter t . The analysis is similar to the one given for 
the discrete time case. 
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